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I.  INTRODUCTION 


To  conserve  time  and  money,  saturated  or  nearly-saturated  experiments  are 
often  designed,  particularly  in  the  early  pilot  phase  of  research  projects 
where  little  is  kr  vn  about  the  priority  of  the  factors  to  be  investigated. 
Sometimes,  an  unanticipated  supersaturated  situation  results  when  a  saturated 
or  nearly-saturated  experiment  is  interrupted  (and  terminated)  before  its 
completion.  Such  a  situation  tends  to  be  associated  with  a  project  which  has 
tenuous  funding  or  which  is  of  uncertain  length,  such  as  occurs  in  operating  a 
new  plant  under  pilot  protocols.  This  type  of  situation  provides  the  rationale 
for  investigating  interruptible  supersaturated  designs.. 

Smith  and  Schmoyer  (1982)  defined  interruptible  designs  as  those  which 
limit  the  adverse  effects  of  an  incomplete  experimental  program,  and  investigat¬ 
ed  the  construction  of  such  designs  where  a  first-order  model  is  assumed  and 
factors  at  only  two  levels  are  considered.  However,  one  of  their  assumptions 
\  was  that  any  experiment  would  not  be  Interrupted  in  the  supersaturated  stage. 

In  this  paper,  we  extend  their  results  by  examining  the  case  where  the 
experiment  is  interrupted  at  a  point  where  less  runs  have  been  made  than  there 
are  parameters  to  be  estimated.  Specifically,  we  consider  designs  with 
k  ■  4(1)9  factors  where  each  factor  has  exactly  two  levels.  For  convenience 
we  code  the  factor  levels  as  (-1,  1}  to  represent  the  low  and  high  level, 
respectively. 

For  each  value  of  k  we  would  like  to  determine  a  sequence  of  runs  which  at 
each  step  is  best  in  some  sense,  and  which  leads  to  a  D-optimal  saturated  design. 
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Thus,  we  want  to  lose  the  least  If  the  experiment  were  interrupted,  but  wish 
to  retain  optimality  if  it  were  completed.  The  specific  D-optimal  designs 
we  consider  in  this  paper  are  the  same  ones  considered  by  Smith  and  Schmoyer 
(1982).  For  k  *  4,  5,  and  6,  we  use  the  designs  given  by  Box  and  Draper  (1971) 
for  k  *  7,  we  use  a  Placket t-Burman  design  [Plackett  and  Burman  (1946)];  for 
k  -  8  and  9,  we  use  the  designs  provided  by  Mitchell  (1972,  1974). 
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II.  OPTIMALITY  CRITERIA 


Optimality  of  designs  is  usually  based  on  the  variance-covariance 
matrix  of  the  estimated  parameters  of  the  linear  model.  Let  (y^, . . . .y^) ' 
be  the  n  x  1  vector  of  observations  from  n  independent  and  homoscedastic 
experiments  with  mean  Xg,  where  the  columns  of  the  n  x  p  matrix  X  specify 
the  levels  of  k«p-l  factors.  From  least  squares  theory,  the  variance- 
covariance  matrix  of  the  estimated  J3  vector  of  effects  is  a  constant  times 
(X'X)-1. 

D-optimality  is  defined  by  the  minimum  of  the  determinant  of  the  (X'X)  1 
matrix  or  equivalently,  by  the  maximum  of  |X'X| .  However  supersaturated 
designs  are  characterized  by  having  fewer  runs  (rows  of  X)  than  parameters 
(columns  of  X).  Thus,  for  a  supersaturated  design,  X'X  is  not  full  rank,  and 
|x'X |  is  identically  zero. 

Booth  and  Cox  (1962)  suggested  an  optimality  criterion  based  on  a  measure 
of  the  orthogonality  of  the  columns  of  the  matrix  X.  If  we  let 
X*  (xq,  x.^,  x^, . . .  ,x^)  where  Xg  Is  the  n-dimensional  vector  of  l's,  and 
x^,  i-l,...,k,  are  the  design  matrix  n-vectors  for  the  k  factors,  then  the 
angle  0^  between  any  two  column  vectors,  x^  and  x ^ ,  is  defined  by 

Cosine  0^  •  x^x^/l  'Xj)**]  • 

Since  all  vectors  in  the  designs  we  consider  only  contain  elements  +1 
or  -1,  they  are  of  the  same  length,  i/n,  and  we  measure  the  optimality  of  a 
supersaturated  design  by 

<P  »  Max  |  |  /n. 
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For  two  or  more  designs  with  the  same  value  of  0,  we  rank  them  by  the 
number  of  pairs  of  columns  achieving  that  maximum.  An  optimal  supersatu¬ 
rated  design  by  this  criterion  minimizes  the  maximum 

this  set  contains  the  sma} lest  number  of  column  pairs  with  0  ,  the  minima* 

min 

1  '  Xj  |  /n  - 

Booth  and  Cox  restricted  their  consideration  to  designs  with  even  n, 
and  an  equal  number  of  +l's  and  -l's  in  each  column.  Then  the  column  x^ 
of  all  l's  was  orthogonal  to  the  remaining  columns.  Since  in  our  investi¬ 
gation  we  allow  for  interruption  after  any  run,  we  consider  both  odd  and 
even  numbers  of  runs,  make  no  restrictions  on  the  number  of  +l's  and  -l's 
in  each  column,  and  treat  the  x^  column  the  same  as  the  ^,...,  columns 
in  our  calculations. 


| x. 'x, | /n  and  within 
1  j 


III.  INTERRUPTIBLE  DESIGNS 


We  obtained  interruptible  designs  by  selecting  a  sequence  of  runs 
which  optimize  at  each  step  the  criterion  presented  in  the  previous  section. 
The  selection  of  runs  was  made  without  replacement  from  the  set  of  k+1  runs 
comprising  the  D-optitnal  saturated  designs  for  k  factors  referenced  in  the 
introduction.  Computer  evaluation  of  all  possible  run  sequences  guided  the 
selection  of  the  optimal  order  of  runs. 

We  also  obtained  worst-case  results  for  each  number  of  runs.  We  define 
the  worst  case  (for  a  given  number  of  runs)  as  that  set  of  runs  which  pro¬ 
duces  i  the  maximum  value  of  <j>.  Further,  if  more  than  one  set  of  runs 
corresponds  to  4»  ,  we  select  as  worst  case  that  set  having  the  largest 

IQdX 

number  of  pairs  with  4  equal  to  <j> 

Y  max 

Tables  1  through  6  present  the  D-optimal  designs  we  have  considered  and 

list  the  runs  in  the  optimal  sequence.  These  sequences  are  not  necessarily 

unique.  For  each  number  of  runs,  the  tables  also  provide  4>min»  the  minimum 

value  of  <(>  for  this  sequence,  and  the  number  of  pairs  for  which  the  minimum 

occurs.  Also,  for  each  number  of  runs,  $  and  the  number  of  pairs  for  which 

max 

it  occurs  is  given  for  the  worst  case.  The  runs  where  <(>  .  and  <J>  differ 

min  max 

indicate  where  the  design  would  be  subopt imal  if  interrupted  without  having 
used  an  optimal  sequence. 


IV.  DISCUSSION 


Except  for  the  case  k-4,  the  sequences  of  design  runs  reveal  that  at 
certain  numbers  of  runs  (asterisked  in  Tables  2  through  6) ,  the  design 
sequences  specified  are  preferred  to  some  other  sequences.  Therefore, 
for  situations  vrhere  it  is  likely  the  design  may  be  interrupted,  these 
sequences  would  be  favorable  in  terms  of  the  criterion  used. 

By  deciding  to  use  these  optimal  sequences  to  pursue  a  saturated  design, 
unrestricted  randomization  would  need  to  be  forsaken.  However,  within  sub¬ 
sets  of  runs  where  the  optimality  is  not  affected  by  choice  of  runs,  the  runs 
could  be  randomly  ordered.  In  situations  where  it  is  possible  that  a  super¬ 
saturated  experiment  may  result,  the  experimenter  should  consider  the  use  of 
our  interruptible  supersaturated  designs,  particularly  if  he  or  she  feels 
that  complete  randomization  may  be  foregone. 
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Optimal  Run 
Sequence 


Factors 


Number 
of  Runs 


-1  -1 


-1  -1 


Optimal  Run  Sequence 
min  No.  of  Pairs 


Worst  Case 


No.  of  Pairs 


Table  1:  Results  for  an  optimal  interruptible  sequence  of  runs  leading 
to  a  D-optimal  saturated  k"4,  N*5  experiment. 
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Number 

Optimal  Run  Sequence 

A 

max 

Worst  Case 

of  Runs 

ymin 

No.  of  Pairs 

No.  of  Pairs 

2 

1.000 

6 

1.000 

7  ** 

3 

1.000 

2 

1.000 

3  ** 

4 

.500 

8 

1.000* 

1 

5 

.600 

2 

.600 

2 

6 

.333 

6 

.333 

6 

*  ^max >  ^min  ^or  some  suboptimal  sequence  of  runs. 

**  ^max*^min’  but  C^e  num^er  pairs  attaining  the  maximum  is  greater. 


Table  2:  Results  for  an  optimal  interruptible  sequence  of  runs  leading 
to  a  D-optimal  saturated  k  ■  5,  N  ■  6  experiment. 
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1 


Optimal  Run 
Sequence 

xo 

X1 

Factors 

x2  x3 

X4 

x5 

X6 

1 

1 

-1 

1 

1 

-1 

-1 

1 

2 

1 

-1 

1 

-1 

1 

1 

-1 

3 

1 

-1 

-1 

-1 

1 

-1 

1 

4 

1 

1 

1 

-1 

-1 

-1 

-1 

5 

1 

1 

-1 

1 

1 

1 

1 

6 

1 

-1 

-1 

-1 

-1 

1 

1 

7 

1 

-1 

-1 

1 

-1 

-1 

-1 

Number 
of  Runs 

Optimal 

^min 

Run  Sequence 

No.  of  Pairs 

Worst 

<p 

max 

Case 

No.  of 

Pairs 

2 

1.000 

9 

1.000 

11** 

3 

1.000 

3 

1.000 

4** 

4 

.500 

12 

1.000* 

2 

5 

.600 

4 

1.000* 

1 

6 

.666 

1 

.666 

1 

7 

.429 

3 

.429 

3 

*  A  >  <b  J  for  some  suboptimal  sequence  of  runs. 

Muax  rrain 

**  A  ■  a  ,  ,  but  the  number  of  pairs  attaining  the  maximum  is  greater. 
rmax  Tmin 


Table  3:  Results  for  an  optimal  interruptible  sequence  of  runs  leading 
to  a  D-optimal  saturated  k»6,  N“7  experiment. 
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Optimal  Run 
Sequence 

xo 

X1 

X2 

Factors 

x3  X4 

X5 

X6 

X7 

1 

1 

1 

1 

1 

1 

1 

1 

1 

2 

1 

1 

1 

-1 

1 

-1 

-1 

-1 

3 

1 

1 

-1 

1 

-1 

1 

-1 

-1 

4 

1 

-1 

1 

1 

-1 

-1 

1 

-1 

5 

1 

1 

-1 

-1 

-1 

-1 

1 

1 

6 

1 

-1 

1 

-1 

-1 

1 

-1 

1 

7 

1 

-1 

-1 

1 

1 

-1 

-1 

1 

8 

1 

-1 

-1 

-1 

1 

1 

1 

-1 

Number 

Optimal 

Run  Sequence 

Worst 

Case 

of  Runs 

^min 

No. 

of  Pairs 

<p 

max 

No. 

of  Pairs 

2 

1.000 

12 

1.000 

12 

3 

1.000 

4 

1.000 

4 

4 

.500 

16 

1.000* 

4 

5 

.600 

4 

.600 

4 

6 

.333 

12 

.333 

12 

7 

.143 

28 

.143 

28 

8 

0 

28 

0 

28 

*  ^max  > ^min  ^or  8ome  suboptimal  sequence  of  runs. 


Table  4:  Results  for  an  optimal  interruptible  sequence  of  runs  leading 
to  a  D-optimal  saturated  k«7,  N  *  8  experiment.  (Resolution 
III  27-1*  design.) 
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Optimal  Run 
Sequence 

*0 

X1 

x2 

Factors 

X3  X4 

X5 

x6  x 

7  X8 

1 

1 

1 

-1 

1 

1 

1 

1 

1  -1 

2 

1 

1 

1 

-1 

1 

1 

-1 

1  -1 

3 

1 

-1 

1 

-1 

1 

-1 

1 

1  -1 

4 

1 

1 

-1 

-1 

-1 

-1 

-1 

1  1 

5 

1 

-1 

1 

1 

-1 

1 

-1 

1  -1 

6 

1 

-1 

-1 

1 

1 

-1 

-1 

1  1 

7 

1 

-1 

1 

-1 

1 

1 

1 

1  1 

8 

1 

-1 

-1 

-1 

-1 

1 

1 

1  -1 

9 

1 

1 

1 

1 

-1 

-1 

1 

1  1 

Number 
of  Run 8 

Optimal 

*min 

Run  Sequence 

No.  of  Pairs 

Worst  Case 
d> 

max  No.  of  Pairs 

2 

1.000 

16 

1.000 

22** 

3 

1.000 

6 

1.000 

9** 

4 

1.000 

1 

1.000 

6** 

5 

.600 

8 

1.000* 

3 

6 

.666 

2 

1.000* 

1 

7 

.429 

9 

1.000* 

1 

8 

.500 

1 

.750 

1 

9 

.555 

1 

.555 

1 

*4>mav  >  4>min  for  some  subopt imal  sequence  of  runs. 

** 

^max  "  ^min’  *5Ut  tlle  num^er  °f  pairs  attaining  the  maximum  is  greater. 

Table  5:  Results  for  an  optimal  interruptible  sequence  of  runs  leading 
to  a  D-optimal  saturated  k*8,  N  -  9  experiment. 
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Number  of 
Runs 

Optimal  Run  Sequence 
^min  No.  of  Pairs 

,  Worst 

0 

max 

Case 

No.  of  Pairs 

2 

1.000 

20 

1.000 

21** 

3 

1.000 

8 

1.000 

9** 

4 

1.000 

2 

1.000 

8** 

5 

.600 

12 

1.000* 

5 

6 

.666 

2 

1.000* 

2 

7 

.429 

12 

.714* 

2 

8 

.500 

2 

.500 

8** 

9 

.333 

8 

.333 

8 

10 

.200 

20 

.200 

20 

*^max  > ^min  ^or  some  su^optimal  sequence  of  runs. 

**^max  "  ^min  *  *5Ut  t*'e  nu,n'5er  pairs  attaining  the  maximum  is  greater. 

Table  6:  Results  for  an  optimal  interruptible  sequence  of  runs  lead- 
J  ing  to  a  D-optimal  saturated  k*9,  N-10  experiment. 
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